Integrated Architectures for Learning , Planning , and ReactingBased
نویسنده
چکیده
This paper extends previous work with Dyna, a class of architectures for intelligent systems based on approximating dynamic programming methods. Dyna architectures integrate trial-and-error (reinforcement) learning and execution-time planning into a single process operating alternately on the world and on a learned model of the world. In this paper, I present and show results for two Dyna archi-tectures. The Dyna-PI architecture is based on dynamic programming's policy iteration method and can be related to existing AI ideas such as evaluation functions and universal plans (reactive systems). Using a navigation task, results are shown for a simple Dyna-PI system that simultaneously learns by trial and error, learns a world model, and plans optimal routes using the evolving world model. The Dyna-Q architecture is based on Watkins's Q-learning, a new kind of reinforcement learning. Dyna-Q uses a less familiar set of data structures than does Dyna-PI, but is arguably simpler to implement and use. We show that Dyna-Q architectures are easy to adapt for use in changing environments.
منابع مشابه
The PELA Architecture: Integrating Planning and Learning to Improve Execution
Building architectures for autonomous rational behavior requires the integration of several AI components, such as planning, learning and execution monitoring. In most cases, the techniques used for planning and learning are tailored to the specific integrated architecture, so they could not be replaced by other equivalent techniques. Also, in order to solve tasks that require lookahead reasoni...
متن کاملImplementation of the integrated management dashboard for learning processes based on ISO 29990
The current research is trying to identify the effective modules (system modules) that form the integrated e-learning dashboard for educational processes and learning opportunities based on ISO 29990 in the municipality of Tehran. The educational process management system, which is currently providing classroom training services, is able to improve the situation by incorporating integrated mana...
متن کاملIntegrated Learning Architectures
Research in systems where learning is integrated to other components like problem solving, vision, or natural language is becoming an important topic for Machine Learning. Situations where learning methods are embedded or integrated into broader systems offers new theoretical challenges to ML and enlarge the potential range of ML applications. In this position paper we propose the research topi...
متن کاملIntegrated Modeling and Control Based on Reinforcement Learning
This is a summary of results with Dyna, a class of architectures for intelligent systems based on approximating dynamic programming methods. Dyna architectures integrate trial-and-error (reinforcement) learning and execution-time planning into a single process operating alternately on the world and on a learned forward model of the world. We describe and show results for two Dyna architectures,...
متن کاملRepresentation a Model of Integrated Curriculum to Happiness(joysfulness) for Primary School
Purpose: The aim of this study was to provide an integrated curriculum model for the revitalization of primary schools. Methodology: The research is descriptive-survey in terms of nature and method of data collection and applied in terms of purpose. The statistical population of this research consists of professors and experts in the field of educational sciences and experts of the General Dep...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006